Entropy production of diffusion in spatially periodic deterministic systems 
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This paper presents an ab initio derivation of the expression given by irreversible thermodynam- 
ics for the rate of entropy production for different classes of diffusive processes. The first class 
are Lorentz gases, where non-interacting particles move on a spatially periodic lattice, and collide 
elastically with fixed scatterers. The second class are periodic systems where A'^ particles interact 
with each other, and one of them is a tracer particle which diffuses among the cells of the lat- 
tice. We assume that, in either case, the dynamics of the system is deterministic and hyperbolic, 
with positive Lyapunov exponents. This work extends methods originally developed for a chaotic 
two-dimensional model of diffusion, the multi-baker map, to higher dimensional, continuous time 
dynamical systems appropriate for systems with one or more moving particles. Here we express the 
rate of entropy production in terms of hydrodynamic measures that are determined by the fractal 
properties of microscopic hydrodynamic modes that describe the slowest decay of the system to an 
equilibrium state. 

PACS numbers: 05.45.Df, 05.60.-k,05.70.Ln 



I. INTRODUCTION 

In 1902, Gibbs described a mechanism by which the en- 
tropy could increase toward its equihbrium value in me- 
chanical systems obeying Newton's equations Gibbs' 
mechanism is based on the assumption that the micro- 
scopic dynamics is mixing. The mixing would allow 
coarse-grained probabilities to reach their equilibrium 
values after a long time, a result that has received a rigor- 
ous meaning in the modern definition of mixing Q . The 
second ingredient of Gibbs' mechanism is the assumption 
that the entropy of a physical system should be defined as 
a quantity which is now referred to as the coarse-grained 
entropy. The use of the coarse-grained entropy could be 
justified by the fact that, if the entropy should be given 
according to Boltzmann by the logarithm of the number 
of complexion of a system, then it can only be defined 
by introducing cells of non- vanishing size in systems de- 
scribed by continuous coordinates. pQ] 

The aim of the present paper is to apply the program 
set up by Gibbs to hyperbolic, deterministic dynami- 
cal systems sustaining a transport process of diffusion. 
We suppose that the systems obey Liouville's theorem, 
namely that phase space volumes are preserved by the 
dynamics, which is a major assumption used by Gibbs. 
Specifically, the systems we consider are either periodic 
Lorentz gases, in which moving particles diffuse through 
a lattice interacting only with fixed scatterers, or are pe- 
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riodic repetitions of interacting iV-particle systems such 
that a tagged particle is followed as it undergoes diffusion 
among the unit cells. The present work is an extension 
to continuous time, and interacting systems, of previous 
works H [sill, 01 concerned with the multi-baker map, 
as a chaotic model of diffusion. In the previous work, we 
used the fact that an initial non-equilibrium distribution 
function, in the multi-baker "phase space" , rapidly devel- 
ops a fractal structure due to the chaotic nature of the 
dynamics. This structure is such that variations of the 
distribution function on arbitrarily fine scales develop as 
the system evolves in time. The final stages of the ap- 
proach to equilibrium are then controlled by the decay of 
fractal, microscopic hydrodynamic modes of the system, 
in this case, diffusive modes, which decay with time as 
exp(— ZJfc^t), where k is a wave number characterizing a 
particular mode associated with a macroscopic density 
variation over a distance of order k~^, D is the diffusion 
coefficient, and t is the time. For the multi-baker system 
it is possible to express the rate of entropy production 
in this final stage in terms of measures of sets which are 
determined by the non-equilibrium phase space distribu- 
tion in the set, in particular, by the values of the fractal 
hydrodynamic modes in the set. 

In this paper we show that it is possible to apply the 
same methods to calculate the rate of entropy produc- 
tion for diffusive flows in periodic Lorentz gases and for 
tracer diffusion in periodic, interacting A'^-particle sys- 
tems, as long as the microscopic dynamics is determin- 
istic, mixing, and chaotic. Our method is based on the 
explicit construction of the microscopic fractal hydrody- 
namic modes of diffusion, which characterize the long 
time relaxation of the system toward thermodynamic 
equilibrium. Our main result is that we obtain by this 
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method exactly the expression for the rate of entropy 
production as given by irreversible thermodynamics for 
these systems!^. The source of this agreement can be 
traced to the role played by the fractal hydrodynamic 
modes, both for requiring a coarse graining of the phase 
space to properly incorporate the effects of their fractal 
properties on entropy production in the system, as well 
as for describing the slowest decay of the system as it 
relaxes to equilibrium. 

The plan of the paper is the following. The mathemati- 
cal methods needed to describe spatially periodic systems 
are provided in Sec. II. Then the non-equilibrium dis- 
tribution is defined in Sec. III. Once the distribution 



function has been constructed, we can identify the mi- 
croscopic hydrodynamic modes of diffusion, and they are 
then constructed in Sec. IV. Here we use the properties 



of these modes to introduce the notion of a hydrodynamic 
measure of a set in phase space, and we also identify the 
sets that are used in the coarse graining of the phase 
space. These sets are not arbitrary, but must have some 
specific properties in order to be useful for the calcula- 
tion of the rate of entropy production, which is carried 
out in Sec. 0. We conclude with a discussion of the 
method and results obtained here, and with an outline of 
directions for future work in Sec. 



VI 



coordinates to the two positions r = {x.y) G Q and the 
velocity angle <f S [0, 27r[. The position space decom- 
poses into a triangular lattice of hexagonal elementary 
cells, each containing a single disk: Q = Uj-^^T'C, where 

T' denotes the translation by the lattice vector I, and 
C is the elementary cell of the position space Q. The 
elementary cell of the phase space has thus the coordi- 
nates X = {x,y,tp) & M = C ® [0,27r[. In the two- 
dimensional Lorentz gas, the phase space has the di- 
mension dim Ai = i while the lattice has the dimension 
d = dim £ = 2. The flow of the hard-disk Lorentz gas 
preserves the Lebesgue measure dX = dx dy dip. We no- 
tice that the horizon of the hard-disk Lorentz gas must 
be finite in order for the diffusion coefficient to be finite 
Q, which we assume in the following. 

Similar considerations apply to the Lorentz gas in 
which a point particle moves in a periodic lattice of at- 
tractive Yukawa potentials. In this system the diffusion 
coefficient is positive and finite for a large enough energy 
JlOt . Here, too, the phase space has 3 dimensions and is 
the union of the constant energy surfaces for each cell of 
the lattice. 



2. The three-dimensional Lorentz gas 



II. SPATIALLY PERIODIC SYSTEMS 
A. The phase space 

We consider a deterministic dynamical system of phase 
space dimension M which is spatially periodic in the form 
of a d-dimcnsional lattice C. We will label the positions 
of the periodic cells on the lattice by the vector I G C, 
and the phase space coordinates within an elementary 
cell hy X G Ai. The lattice C is isomorphic to Z''. The 
total phase space of the system is the direct product M. 
C of dimension M. The time displacement operator over 
a time interval t, acting on points {l,X), is denoted 
which is also called the flow. On the other hand, the time 
displacement operator acting on points X inside the basic 
unit cell is denoted 0*. 

Examples of such systems are the following. 

1. The two-dimensional Lorentz gas 



This Lorentz gas is the direct generalization of the two- 
dimensional one. The spatial coordinates vary over the 
space with the exclusion of the volume occupied by the 
spheres: r G Q with dim Q = 3. The velocity coor- 
dinates form another three-dimensional vector G M'^. 
In each energy shell, we can reduce the coordinates to 
the three positions r [x, y, z) G Q and the two ve- 
locity spherical angles 9 G [0,7r] and ip G [0,27r[. The 
position space decomposes into a lattice of elementary 
cells containing one or several disks: Q — yjj^^^T^C. The 
elementary cell of the phase space has thus the coordi- 
nates X = {x,y, z, cos9,ip) G M^C® [-1, +1] ® [0, 27r[, 
where, again, C is the elementary cell of the position 
space Q. In the three-dimensional Lorentz gas, the phase 
space has the dimension dimAI = 5 while the lattice 
has the dimension d — dim £ = 3. The flow of the 
hard-disk Lorentz gas preserves the Lebesgue measure 
dX = dx dy dz d cos 9 dip. Here also, we suppose that the 
horizon is finite in order for the diffusion coefficient to be 
finite. 



In this system a point particle moves in free flight and 
undergoes elastic collisions on hard disks forming a tri- 
angular lattice. The phase space is defined by the spa- 
tial and velocity coordinates (r, v) of the moving particle. 
The spatial coordinates vary over the plane with the ex- 
clusion of the area occupied by the disks: r G Q with 
dim Q = 2. The velocity coordinates form another two- 
dimensional vector ■(7 G M^. Energy is conserved during 
the motion so that each energy shell is preserved by the 
dynamics. In each energy shell, we can thus reduce the 



3. Diffusion of a tracer in a system on a torus 

The molecular dynamics simulation of the diffusion of 
a tracer particle moving in a fluid can be performed by 
considering a finite number of particles modeling the fluid 
and the tracer particle, all of them moving with interac- 
tions, in a domain delimited by periodic boundary con- 
ditions. The total number of particles is equal to N . 
The center of mass can be taken at rest. The vector I 
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can be used to locate the position of the cell containing 
the tracer particle as it moves on the checkerboard lat- 
tice made of infinitely many images of the system, which 
tiles the d-dimensional space of the system. Then the 
diffusion coefficient of the tracer particle can be com- 
puted by adding the appropriate lattice vector to I each 
time the tracer particle crosses a boundary. The en- 
ergy and total momentum are to be conserved so that 
here X denotes the phase space coordinates of an ele- 
mentary cell of the phase space, which is of dimension 
M = dim M = 2dN — 2d — 1 after elimination of the d 
degrees of freedom of the center of mass, while the lattice 
is of dimension d = dim £ = 2 or 3. 

In summary, we will denote by X the coordinates on 
an energy-momentum shell of a micro-canonical ensem- 
ble for the periodic system. We suppose that the flow $* 
preserves the Lebesgue measure dX. Moreover, we as- 
sume that the diffusion coefficient of the system is finite, 
that the mean drift vanishes, and that the microscopic 
dynamics is chaotic and mixing. In the sequel I will de- 
note the lattice position vector and T the translation 
operator on the lattice. Subsets of the unit cell A4 will 
be denoted by capital Roman letters. The notation A 
will be used for a set belonging to the elementary phase 
space cell at the origin ^ = of the lattice. The notation 
Aj^ = T^A will be used when we want to refer to a set in 
a specific lattice cell at position 



A. The non-equilibrium measure 

We now construct the statistical ensemble we will use 
for the rest of this paper. We suppose that the coordi- 
nates of the ensemble are distributed on the lattice in 
such a way that the distribution can be described by an 
initial ensemble density jo(i,X, 0), where p denotes the 
number of systems per unit phase space volume. We 
take this density to be close to that of total equilibrium 
and write it in the form 



p(Z;x,0) = Peq 1 + R{IX,Q) 



(2) 



where the equilibrium distribution poq is, for Lorentz 
gases, uniform with respect to the cells I, and with re- 
spect to the phase variables X in agreement with the 
assumption that the Lebesgue measure dX is preserved 
by the flow $*. For the case of tracer diffusion, peq is 
the equilibrium micro-canonical distribution for the N 
particles in a cell on the lattice. The initial deviation 
from equilibrium in the cell located at I is denoted by 
0), which we assume to be Lebesgue integrable 
when weighted with the equilibrium distribution. Using 
the lattice Fourier transform, Eq. (Q), we can express 
this deviation in the form 



i?(;,X,0) 



I 

W\ 



dk e** ' R{k,X) 



(3) 



B. Lattice Fourier transforms 

We will also need to define lattice Fourier transforms 
Ll| . We will need the preliminary result : 



The phase space density (^) leads us to the definition of 
the non-equilibrium measure of a set Aj- belonging to the 

phase space cell T'^M. corresponding to the lattice vector 



Deflnition 1 Consider a Junction G{l,X), which is a 
function of the lattice coordinate I, and the unit cell co- 
ordinate X , then this function can he expressed in terms 
of a lattice Fourier transform as 



G{l,X) 



1 

W\ 



dk e'"-' G{k,X) , 



(1) 



where B denotes the first Brillouin zone of the reciprocal 
lattice, \B\ is its volume, and G is the lattice Fourier 
transform ofG. 



Deflnition 2 The equilibrium measure viAj-) of a set Aj^ 
is defined by 



iy{Aj-) = / dXp^q , 



(4) 



and the non- equilibrium measure, /it(Aj-), of the same set 
by 



lit [Ajj = / dXp{l, X, t) = viA^) + Spt ( A-) ' (5) 



It is important to note that : 

Lemma 1.1 If G is only a function of the lattice vector 
I, then G does not depend upon the unit cell coordinate 
X, but only upon k. 



III. THE NON-EQUILIBRIUM DISTRIBUTION 

We consider a periodic deterministic dynamical system 
with finite diffusion coefficient. 



where 



SnMr)= I dx p,^R{i,x,t) 



(6) 



We will simplify matters a bit by assuming that the 
initial deviation from equilibrium R{1, X, 0) depends only 
upon the cell I but not on the initial phase X of the sys- 
tem within the cell. In this case the Fourier transform 
R{k, X) does not depend upon X, either, and will hence- 
forth be denoted by F^. 
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The time dependent distribution function p{l,X,t) is 
the solution of Liouville's equation and is given by 



pil,X,t) 



Poq 
Poq 



l + R{l,X,t) 



1 



(7) 



T— / dk Fr e 

LSI '-- 



1^ j*:-L[$"'(/"x,0)] 



Here L denotes the projection on the lattice coordinate, 



thus L 



is the lattice vector of the cell in 
which a moving particle would be located at time —t if it 
were in cell I at time t = 0, with phase X. We can express 
the time dependent deviation from total equilibrium in 
the form 



1 



Ril,X,t)^—J^dkFj:e 



ik-[r+d(X,t)] 



(8) 



where the backward displacement of the lattice vector I 
over a time interval t is defined by 



d{X,t) = L $"*(/^X,0) 



(9) 



We will make heavy use of the fact that d{X, t) depends 
upon the time interval (— 1,0) and upon the phase point 
X, at the initial time, but not upon the initial cell I. In 
other words, the periodicity of the lattice and the dy- 
namics produce a "winding number" d{X^ t) that does 
not depend upon the cell in which the trajectory is lo- 
cated at the initial time. We remark here that the long 
time limit of the displacement vector d{X, t) may be a 
wildly varying function of the phase coordinate X. Thus 
we expect that the decaying modes of the time depen- 
dent distribution (|^) are singular functions of the phase 
coordinates. 

We define the time dependent density of the tracer 
particle by integrating the phase space density over the 
coordinates X of an elementary phase space cell of the 
lattice il : 



n{l,t)= dX p{l,X,t)= ^it{Mi) 

JM 

Using Eq. (^), we obtain the density as 
n{lt) = v{M) 



(10) 



(11) 



1 



1 

LSI 



dk Fj: e 



ik-l Im dXpcq 



pik-d(X.t) 



We consider times t that are long compared to the 
mean time between collisions of the moving particles, but 
short compared to the time needed for the system to 
relax to total equilibrium. For such times, we expect 
the time dependent deviation from total equilibrium to 
decay exponentially with a rate —s^ given by the van 
Hove relation 



1 

i— »oo t 



Sk = lim ^ln(e"^-'^(^'*))^ 



= hmilniM^^^- — 

i^oo t dXpcq 



ik-d(X,t) 



(12) 



which gives the decay rate of a hydrodynamic mode of 
diffusion of wave number k. An expansion in powers of 
the wave number gives 



sk = -De + o{k^) 



(13) 



with diffusion coefficient D. We have here assumed that 
the diffusive motion of the tracer particle is invariant 
under space inversion so that all the odd powers of the 
wave number vanish. We notice that the existence of the 
successive terms of the expansion in powers of the wave 
number depends on the existence of the super-Burnett 
and higher diffusion coefficients |l^, which has been re- 
cently proved for the hard-disk periodic Lorentz gas with 
a finite horizon jlJ. 

The definition (|12D shows that 



Jk-d(X,t) 



Im d^P'^ 



C{k,t) e' 



(14) 



where C{k,t) is a function of the wave number k with a 
sub-exponential dependence on time, i. e. 



lim -\nC{k,t) = . 

t—*oo t 

Accordingly, the tracer density can be written as 



(15) 



n{l,t) = v{M) 



l + -^J^dkF^e''^-^Cik,t) e'"* 



(16) 

Notice that n{l, t) obeys a form of the diffusion equation, 
appropriate for our lattice system, given by 



dn{l,t) iy{M) 



dt 



B\ JB 

v{M) 



dkFj:e'''-'C{k,t)ske"'' + ' 



-D 



\B\ 



dk Fj: k^ e 



2 ik-l 



C(k,t) e" 



(17) 



which, in the scaling limit where the size of the unit cell 
becomes small and for large times and small wave num- 
bers, is the diffusion equation: 



dn{l,t) 
dt 



D 



dp 



(18) 



IV. THE HYDRODYNAMIC MODES 

A. The hydrodynamic measures 

Spatially periodic deviations from total equilibrium 
characterized by the wave number k relax exponentially 
at the rate given by van Hove's relation p^ . Our pur- 
pose is here to determine the non-equilibrium state cor- 
responding to this mode of exponential relaxation. This 
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state can be defined as a measure, wfiicfi we call a hy- 
drodynamic measure, associated with the hydrodynamic 
mode of diffusion, ft is the microscopic analog of the 
solutions exp{ik ■ I — Dk^t) of wave number k for the 
macroscopic diffusion equation (|8|). 

We introduce the hydrodynamic measures by consid- 
ering the deviations from the equilibrium measure for a 
set Af. 



5i^t{Af) 



I dX p,^R{tx,t) , 



At 

v{M) 
'ei .IB 



dk Fr e'''-^ ^ 



Im dXpcq 



J^dXp,^ e^^<^''^ 
Jj^dXp,^ e^f^<^-^^) 



(19) 



where we have used the property that the backward dis- 
placement d{X, t) is independent of the initial lattice vec- 
tor I so that the integral over the set Aj- is equal to the 
integral over the set A of the elementary cell at the ori- 
gin of the lattice. In the last line, we have factorized 
the exponential decay according to Eq. (14), which is 
independent of the set A, from a further factor, which 
depends on the set A but which is expected to have a 
well-defined limit for t oo because both its numerator 
and denominator are expected to decay exponentially as 
exp(sj,i). This observation motivates the 

Definition 3 The hydrodynamic measure x^iA^t) is de- 
fined by 



Xj:iA,t) = lyiM) 



J^dXp, 



cq 



^ik-d{X,t) 



Jj^ dXp,^ ek-d{x,t) 



(20) 



We emphasize that the hydrodynamic measures are in- 
dependent of the cell location I. We notice that the hy- 
drodynamic measures are complex measures because of 
the lattice Fourier transform. 

One important property of the hydrodynamic mea- 
sures is that the total hydrodynamic measure of a unit 
cell is constant in time, as follows from the definition |^. 
That is. 

Lemma 3.1 For the set A = A4, i. e., the phase space 
region associated with an entire unit cell, the hydrody- 
namic measure is 



X-,{M,t)^:.{M) . 
Another observation is that 



(21) 



Lemma 3.2 // we make a k-expansion of the hydrody- 
namic measure of the form 

Xj:{A, t) = v{A) + ik ■ f (A, i) + fcfc : g (A, i) + • • • , (22) 



it follows from Eq. (|^, that T{M,t) = and that 
"g{M,t) = 0, etc. 

Properties like these have already been used in the var- 
ious symmetric, multi-baker models @, ||, ^- For a 
system with vanishing mean drift {d{X,t)) m = 0, the 
two first coefficients of the fc-expansion of the hydrody- 
namic measures can be expressed as 



T{A,t) - u{A) {d{X,t))A 



(23) 
(24) 



X {d{X,t)d{X,t))M- {d{X,t)d{X,t))A 



with the definition 



Ia dXpcqj-) 

Ia '^^P^'l 



(25) 



Thanks to the hydrodynamic measures Eq. ( ]20| ) and 
Eq. dlj), we finally derive from Eq. (fol) an expression 



for the measure of a set A in cell TW^- : 



Pt{A^) = y{A) + 5pt{Aj) 



(26) 



-±.J^dkFj:e'^'-^C{k,t) e^'=*Xfe(Ai) 



B. Conservation of measure and de Rham-type 
equation 

Since the time evolution is a measure preserving Liou- 
ville operator, the measure of any set A remains constant 
as the set follows the motion of the system in phase space. 
Therefore we may express this conservation of measure 
as 



Pt+riA) =pt{<i> ^A). 



(27) 



Here t denotes some time interval, and ^~'^A is the pre- 
image of the set A under the flow, obtained by following 
the backward evolution of the points of A over a time 
interval r. This simple result has some important conse- 
quences, among them, a de Rham-type equation for the 
hydrodynamic measures. 

We suppose that the sets A are sufficiently small that 
all the points in them will flow through the same sequence 
of cells over some large time interval (— T < r < T). In 
such a case the set of points ^~'^A are all in the same cell 
with location denoted by l-\-d(XA, t) which is determined 
by the backward evolution of an arbitrary phase point 
Xa in the set A. Using Eq. ([2^), we can express the 
application of Eq. ( p7| ) to a set A^- as 
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^ I dkF^ e'^-'C{k, t + t) e(*+^)^'= x^iA, t + r) = ^ I _ dk e^^'-['+'^^(^-'^)l C{k, t) e'-' X^i^'^ A, t) . (28) 



r 



Since this equation must be true for all cells I for all 
F^, and for all sets A satisfying the above condition, the 
only way it can be satisfied is if the integrands are equal 
almost everywhere. Equating the integrands leads to the 
equation 



C{k,t- 



^^XkiA,t + T) = 
C{k,t) Xki^-^A,t) 



(29) 



Since the hydrodynamic measures do not depend on the 
lattice vector, the pre-image ^~'^A under the full flow 
over the lattice can be reduced to the pre-image (j)~'^A 
under the flow defined with periodic boundary conditions 
inside the elementary cell 7W at / = 0. 

Now we suppose that the dynamics is hyperbolic in 
order to assert that the hydrodynamic measures XkiA, t) 
reach asymptotic forms exponentially rapidly, that is, on 
a time scale of the order of the inverse of the positive 
Lyapunov exponent for the system. In this case, we can 
replace the hydrodynamic measures in Eq. (^9|) by their 
asymptotic forms, denoted by XkiA), in the long time 
limit t — > oo. Moreover, we have the property that 



hm £(M±l)^i 

t — >oo 



(30) 

C{k-t) 

as a consequence of the sub-exponential behavior ( [l5| ) of 
the functions C{k,t). 

In the long time limit t — > oo, combining Eqs. ( p9| ) 
and (|30|), we obtain the 

Lemma 3.3 The hydrodynamic measures satisfy a de 
Rham-type equation : 



xdA) 



_ ik-d(XA,T) 



X£(</>-^^) • (31) 



Explicit solutions of this eq uation have been found for 
multi-baker maps |0, |l5[ For the hard-disk Lorentz 
gas, these solutions lead to the cumulative functions con- 
structed in reference with one-dimensional sets A 
and in reference [ pl] | with two-dimensional sets A. An 
alternative form of Eq. (|l]) is 



XkiA) 



(32) 



Equation (^2|) has an expansion in powers of the wave- 
number k which will be useful in the calculation of the 
rate of entropy production. In obtaining these expansions 
we will make use of the fc-expansions of the Xk functions 
given in Eq. (22). The wave number expansion of Eq. 
32|) leads to the following equation for terms of order k: 

k ■ f{(j/A) = k ■ f{A) -t- v{A) k ■ dL{X^.A, t) . (33) 



C. Partition of phase space and sum rules 

We consider a partition {Aj} of the elementary cell M. 
at / = of the phase space into disjoint sets Aj-. 

LIa,cmAj=M, A.nAj =tD,yi, j, i^j . (34) 

We notice that the images (j>'^Aj also form a partition of 
the elementary cell of phase space: 



(35) 



We can apply the de Rham-type equation (^ to one 
set Aj of the partition (^) and sum both members of 
Eq. ( 13^ ) over all the sets Aj G to obtain: 



with the notation 



(36) 



(37) 



Since the sets <t>^ Aj form a partition of M into disjoint 
sets, we infer from Eq. ( pT| ) that 

^ XMA,) = Xi{M) = v{M) . (38) 

3 

SO that Eq. ( |36| ) becomes 

HM) e^"- = ^ e*-^-^- x-Mi) ■ (39) 
i 

Now, we perform a wavenumber expansion of both 
members of Eq. (|9|) using Eqs. ( p^ ) and (p^). Using 
the properties 



Y.u{A,) = u{M) , 

3 

J2f{A,) = f{M) = 0, 

3 

Y.'giA,) = ?(A^) = 0, 



(40) 
(41) 
(42) 



the identification of the terms which are of the first and 
second powers of the wave number k gives us the follow- 
ing two sum rules: 

J2djHAj)^0, (43) 

3 

[dj f{A,) + f{A,) d, + d, d, y{A,) = 

3 

2Dt iy{M) 1 . (44) 
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Equation (Q) is fundamental for the following develop- 
ment because it constitutes a sum rule relating the dif- 
fusion coefficient to the first coefficients T{Aj) of the 
wavenumber expansion of the hydrodynamic measures 
which is linear in the wave number k. The measures 
T(Aj) have been interpreted elsewhere as the stationary 
non-equilibrium measures associated with a gradient of 
concentration of tracer particles across the system. In 
the case of the multi-baker maps, T{Aj) is given by the 
difference of the Takagi function at both ends of the one- 
dimensional sets Aj |6). The sum rule (^J) thus relates 
the diffusion coefficient to the generalization of the Tak- 
agi function for the present system. 



by this partition as: 



(45) 



This partition can be seen as a translationally invariant 
grid extending over the whole phase space. 

We begin by defining the entropy of the lattice cell 
at time t as the coarse-grained entropy of this cell with 
respect to the partition (Ea): 



St{Mj\{A,}) ^ - J2 f'tiA,) 



In 



+S,^{Mj\{A,}) , 



(46) 



V. ENTROPY PRODUCTION 

A. Definitions 

In this section we are going to calculate of the rate of 
irreversible entropy production over a time t, assuming 
that t > r. 

For our calculation of the rate of entropy production 
in a unit cell of the periodic lattice, we use a partition 
of the total phase space into the small disjoint sets Aj 
defined above Eq. (28). We suppose that the partition 

is invariant under the spatial translations T' . The phase 
space cell located at the lattice vector I is decomposed 



where we have set Boltzmann's constant equal to unity, 
kB — I- The first term on the right hand side of Eq. 
( ^ ) is the non-equilibrium relative entropy with respect 
to the equilibrium entropy for this partition. The equi- 
librium entropy is given by 



S,^{Mj^{A,}) = 



(47) 



where c is a constant which fixes the absolute value of the 
equilibrium entropy. The time variation of the entropy 
over a time interval r is of course only due to the change 
in the relative entropy, and is defined as the difference 



A^S{Mr) ^ St{Mj^{A,}) - St-AM^{A,}) , 

= StiM^\{A,}) - Sti'P^M^li'P^A,}) . (48) 

On the other hand, the entropy flow is defined as the difference between the entropy which enters the cell A^^- and 
the entropy which exits that cell: 

A:S{Mr) ^ St-r{^--Mji{A,}) - St.AMjiiA,}) , 

= StiMj\{'S>^A,}) ~ 5,(cE.-X,H{$M,}) . (49) 



Accordingly, the entropy production over a time r, as- 
suming that t ^ T, is defined as 

AIS{M^) = A"5(7U;-.) - A^5(X;-.) , 

= St{M^{A,}) - StiM^i^^A,}) . (50) 



B. Calculation of the entropy production 

Equation ( pO| ) gives the expression of the entropy pro- 
duction as the difference between the entropy with re- 
spect to the original partition into sets Aj and the en- 
tropy with respect to a partition into sets which are the 
images ^'^ Aj of the sets Aj after time t. We notice that 



each set Aj belongs to a single unit cell A^;-by a pre- 
vious assumption. Moreover, since the partition is in- 
variant under translation from cell to cell, the partition 
{^'^ Aj} is identical to the partition {(fi^ Aj} obtained by 
using the flow on the torus. 

Written out in full, this entropy production is 



AlS{Mr) 



+ E Ait(0"^j) In 



Mil 



'A, 



tp^AjCMf 



(51) 



where we have used v^cj)^ Aj) = v{Aj). Next we expand 
in powers of the deviations of the measures from their 
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equilibrium values and find 



We now use the explicit forms for the measures 
given by the second term on the right hand side of Eq. 
( p6| ) . After some algebra and the use of the conservation 
of measures, as well as the summation formulas (|4l| ) and 
( ^ ) , we find that the right hand side of Eq. (|2|) becomes 



1 1 

2 Lgp 



B 



xe 



(53) 



Here the summation is over the sets Aj that form a partition of the unit cell A4^: Now we use the identity ( |33[ ) and 
the sum rule (H') to obtain our central result 



ISP 



dki F^^ / dk2 Fj:^ ki ■ ^26*'"^''^^+^'' C{ki,t) C{k2,t) e('"'i+"''2)* 



D T 



dn{l,t) 
dl 



(54) 



since the tracer density is expressed according Eq. ( |l^ ) 
and = i^(A^). 

Here we have used the isotropy of the motion, in order 
to eliminate correlations between the displacements in 
orthogonal directions. This results in the factor fci • ^2 
appearing in the integrand in Eq. (]5^). We have also 
implied a scaling limit in order to write the last line of 
this equation. 



VI. CONCLUSIONS 

In this paper, the irreversible entropy production has 
been derived from statistical mechanics for a process of 
diffusion in periodic, deterministic dynamical systems. 
The derivation starts from Gibbs' coarse-grained entropy, 
assumes that the system is spatially periodic, and that 
the dynamics satisfies Liouville's theorem, is chaotic and 
mixing. We chose a coarse graining partition of phase 
space which has the property that any two trajectories 
starting in the same set of the partition will remain close 
together over some specified time interval. The central 
quantities appearing in our derivation are the hydrody- 
namic measures. They define, at the microscopic level, 
the hydrodynamic modes of diffusion which are exponen- 
tially damped at a rate given by the van Hove dispersion 
relation for diffusion. These hydrodynamic measures de- 
scribe the approach to the thermodynamic equilibrium 
under the diffusion process. In deterministic systems, 
the hydrodynamic measures turn out to be singular. In- 
deed, the quantity T{A) is a measure describing a non- 



equilibrium stationary state corresponding to a gradient 
of concentration across the system and, in the multi- 
baker, the cumulative function of this measure is known 
to be the continuous but non-differentiable Takagi func- 
tion . On the other hand, it has been shown elsewhere 
that the hydrodynamic measures are singular in periodic 
Lorentz gases It should be emphasized here that 

the hyperbolicity of the system is used to argue that the 
time dependent hydrodynamic measures, defined by Eq. 
( pO| ) approach their asymptotic forms, with variations on 
arbitrarily fines scales in phase space, on time scales de- 
termined by the positive Lyapunov exponents, which are 
very short compared to the time scales necessary for the 
relaxation of the density distribution to equilibrium. Of 
course, not all systems with macroscopic diffusion and a 
positive rate of entropy production are chaotic, e.g wind- 
tree models with non-overlapping trees ]T^. In such sys- 
tems the mechanism responsible for positive entropy pro- 
duction is expected to develop on algebraic rather than 
exponential time scales, as is the case for chaotic systems. 

Moreover, if the hydrodynamic measures were regular, 
expression (|5^ ) for the entropy production would van- 
ish, as shown in the case of the multi-baker map ^. 
Accordingly, the singular character of the hydrodynamic 
measures plays an essential role in the positiveness of the 
entropy production expected from irreversible thermody- 
namics. A further point we want to emphasize is that the 
present derivation leads naturally to a positive entropy 
production in agreement with the second law of ther- 
modynamics. Finally we point out that our derivation 
of the expression given by irreversible thermodynamics 
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for the rate of entropy production applies not only to 
Lorentz gases, but also to tracer diffusion taking place in 
a spatially periodic N particle system, where the mech- 
anism for tracer diffusion is provided by the particles in- 
teracting with each other. Without this interaction, the 
motion of the tracer particle would be ballistic, and the 
mean square displacement would grow quadratically with 
time. 

The next steps to be taken in the development of this 
approach to the theory of entropy production in the re- 
laxation of fluid systems to thermal equilibrium is to gen- 
eralize the method given here for tracer diffusion in a pe- 
riodic N particle system to viscous and heat flows. We 
shall report on the derivation of entropy production for 
these other transport processes in future publications. 
Finally one would like to remove the restriction to peri- 
odic systems, and to consider the entropy production for 
a general, isolated N particle system relaxing to thermal 
equilibrium. This remains open for future work. 

It is necessary mention that our approach to entropy 
production in fluids has been criticized by Rondoni and 
Cohen in a series of papers This is not the place to 
provide a detailed response to their criticisms, which we 
will do in separate publications. However, it is appropri- 
ate here to mention two issues that are of some impor- 
tance for our response to their comments. (1) Rondoni 
and Cohen find it troublesome that the time needed for 
our method to be applicable depends on the nature of the 
partition chosen for the calculation of the relative entropy 
and its change with time. While this observation is in- 
deed correct, the consequences are not problematic. The 
essential point to note is that for a non-zero rate of irre- 
versible entropy production to result from our method. 



we require a partition which is coarser than the scale 
of variation of the non-equilibrium distribution function. 
As we have tried to make clear, the non-equilibrium dis- 
tribution function develops a fractal structure on a time 
scale set by the magnitude of the largest positive Lya- 
punov exponent. For the systems described here, this is 
a time scale which is very short compared to the time 
scale over which the system relaxes to equilibrium. In 
fact, this time scale is on the order of the mean free time 
between collisions, a scale sufficiently short that more 
traditional methods for computing the rate of entropy 
production, based upon the Boltzmann equation, for ex- 
ample, do not apply, either. (2) Rondoni and Cohen have 
also objected to our use of multi-baker maps and Lorentz 
gases as examples of systems to which non-equilibrium 
thermodynamics might be applied. While one might ob- 
ject to their view of the utility of simple model systems 
for the development of physical intuition, our calcula- 
tion of the rate of entropy production for tracer diffusion 
in an N particle system, shows that the method can be 
applied to much more general systems than multi-baker 
maps and Lorentz gases. Our future work will be devoted 
to seeing exactly how general this method might be. 

Acknovifledgments: The authors would like to thank 
the Max Planck Institute for Physics of Complex Sys- 
tems, Dresden, for its hospitality while part of this 
work was carried out. JRD thanks the National Science 
Foundation for support under grant PHY 98-20824; PC 
thanks the National Fund for Scientific Research (FNRS 
Belgium) for financial support; TG thanks the Israeli 
Council for Higher Education and the Feinberg Postdoc- 
toral Fellowships Program at the Weizmann Institute of 
Science for financial support. 



[1] J. W. Gibbs, Elementary Principles m Statistical Me- 
chanics Yale U. Press, New Haven, (1902); reprinted by [11] 
Dover Publ. Co, New York, (1960). 

[2] A non-technical account may be found in J. R. Dorf- [12] 
man, An Introduction to Chaos in Nonequilibrium Statis- [13] 
tical Mechanics, (Cambridge U. Press, Cambridge, 1999); 
A more mathematical discussion is given by A. Lasota [14] 
and M. C. Mackey, Chaos, fractals, and noise, (Springer- 
Verlag, New York, 1994). [15] 

[3] P. Gaspard, J. Stat. Phys. 88 1215, (1997). [16] 

[4] S. Tasaki and P. Gaspard Theoretical Chemistry Ac- 
counts 102, 385, (1999). [17] 

[5] S. Tasaki and P. Gaspard, J. Stat. Phys. 101, 125, (2000). 

[6] T. Gilbert, J. R. Dorfman, and P. Gaspard, Phys. Rev. [18] 
Lett. 85, 1606, (2000). 

[7] T. Gilbert, and J. R. Dorfman, Physica A 282, 427, [19] 
(2000). 

[8] S. de Groot and P. Mazur Non-equilibrium Thcrmody- [20] 
namics, (North-Holland, Amsterdam, 1962); reprinted 
by Dover Publ. Co., New York, (1984). 

[9] L. A. Bunimovich, and Ya. G. Sinai, Commun. Math. 
Phys. 78, 247, 479, (1980). 
[10] A. Knauf, Commun. Math. Phys. 110, 89, (1987); Ann. 



Phys. (N. Y.) 191, 205, (1989). 

P. Gaspard, Chaos, Scattering and Statistical Mechanics, 

(Cambridge U. Press, Cambridge, 1998). 

L. Van Hove, Phys. Rev. 95, 249, (1954). 

See, for example, H. van Beijeren, Rev. Mod. Phys. 54, 

195, (1982). 

N. I. Chernov and C. P. Dettm ann, Physica A27 9 37, 
(2000); C. P. Dettmann preprint ^n.CD/000303^ . 
S. Tasaki, and P. Gaspard, J. Stat. Phys. 81, 935, (1995). 
T. Gilbert, J. R. Dorfman, and P. Gaspard, Nonlinearity 
14, 339, (2001). 

P. Gaspard, I. Glaus, T. Gilbert, and J. R. Dorfman, 
Phys. Rev. Lett. 86, 1506, (2001). 

E. H. Hauge and E. G. D. Cohen, J. Math. Phys. 10, 
397, (1969). 

L. Rondoni and E. G. D. Cohen, Nonlinearity, 13, 1905, 
(2000); and (to be published). 

With the advent of quantum mechanics this size turned 
out to be equal to h^ where h is the Planck constant and 
/ the number of degrees of freedom. In classical systems, 
the size of the cells remains arbitrary, which is related to 
the fact that classical physics does not fix the constant 
of entropy. 



10 

[21] We will use the term density of the tracer particle to refer of N moving, interacting particles, 

both to the density of moving particles in a Lorentz gas as 
well as to the density of the tracer particle in the system 



